The probability to find no significance by multiple comparison when ANOVA is significant

Permutation versus Bootstrap Significance Tests in Multiple Regression and Anova

Kempthorne's (1952) formulation of the randomization test is extended to yield a permutational analog of the bootstrap significance test. In the new test, residuals of a multiple regression are permuted instead of being bootstrapped. The test is an attractive alternative for Oja's test that permutes predictors (Austr. J.

When Is the Probability Ranking Principle Suboptimal?

Grapefruits and drugs: when is statistically significant clinically significant?

Editorial Lown et al. (1) report a significant advance in describing a new mechanism by which ingested nutrients may change exposure to drug therapy. Grapefruit juice was reported to increase plasma concentrations of felodipine and nifedipine when the drug was concurrently administered with grapefruit juice (2). The potential clinical importance of such an interaction was noted when cyclosporin...

Statistical significance: is it really that significant?

Sample Size Considerations for Multiple Comparison Procedures in ANOVA

Adequate sample sizes for omnibus ANOVA tests do not necessarily provide sufficient statistical power for post hoc multiple comparisons typically performed following a significant omnibus F test. Results reported support a comparison-of-most-interest approach for sample size determination in ANOVA based on effect sizes for multiple comparisons. Introduction The determination of an appropriate s...